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Abstract 

Results for estimating the convergence rate of non-stationary distributed consensus algorithms 
are provided, on the basis of qualitative (mainly topological) as well as basic quantitative information 
(lower-bounds on the matrix entries). The results appear to be tight in a number of instances and 
are illustrated through simple as well as more sophisticated examples. The main idea is to follow 
propagation of information along certain spanning trees which arise in the communication graph. 

AMS Mathematical Subject Classification: 93C05, 05C50, 05C90, 93C55, 93D20, 98R10. 

1 Introduction 

Historically appeared in the areas of communication networks, control theory and parallel computation, 
the analytical study of ways for reaching consensus in a population of agents is a problem of broad 
interest in many fields of science and technology. Questions of this nature arise in peer-to-peer and 
sensors networks [7J [T] , in the manoeuvring of groups of vehicles [2J [22J 1331 , in the study of TCP protocols 
[3] , in the theory of coupled oscillators [El [201 13H] , in neural networks [Hj , but also in apparently 
distant fields such as in the study and modeling of opinion in social science [23] or of animal flocking 
[Uj. 

Generally speaking, the aim of such studies is to design or analyse decentralised algorithms through 
which "agents" (which in the previous examples can be cars or unmanned aerial vehicles, nodes in 
communication network, sensors, particles, cells, fish. . . ) can update their internal states in order to 
agree on a common value for such variable. In general, the latter shall not be a priori fixed, but will 
be determined as a result of the interactions and of their historjQ. These interactions can be modeled 
cither as unidirectional or bidirectional, corresponding to different extreme situations in which one agent 
is able to influence somebody else without being affected by the internal state of the receiver (as in 
hierarchical communication flows) or, the opposite situation, in which influence between agents is always 
symmetrical. 

Of particular interest is the question of estimating how quickly consensus is reached on the basis of 
few qualitative (mainly topological) information as well as basic quantitative (mainly the strength of 
reciprocal influences) information on the network. 

Originally, the problem of quantifying the convergence rate towards consensus was considered mainly 
in the context of stationary networks. For Markov chains, i.e., this amounts to quantify the speed at 
which steady-state probability distribution is achieved, and is therefore directly related to finding an a 
priori estimate to the second largest eigenvalue of a stochastic matrix. Classical works on this subject 
are due to Cheeger and Diaconis, [THIEI], see also [H] for improved bounds. 

Among the classical contributions which instead deal with time- varying interactions we refer to the 
work of Cohn, [llj . where asymptotic convergence is proved, but neglecting the issue of relating topology 
and guaranteed convergence rates. J.N. Tsitsiklis et al. also provided important qualitative contributions 
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to this subject [52 GUI 03 , as weu as L. Moreau [57]- See also |3] for further nonlinear results. In particular, 
the role of connectivity of the communication graph in the convergence of consensus has been recognised 
and finely analysed. 

As noticed in different manners by the preceding authors, arguments based on graph theory are more 
powerful and seem to catch in a more natural way the essence of the problem, rather than computations 
based on linear algebra techniques (although the study of stochastic matrices offer nowadays, undoubt- 
edly, quite strong results). We are in perfect harmony with the opinion that vision in terms of graph is 
central to understand the agreement issues. However, it appears that some dynamical aspects which have 
been so far disregarded can be exploited to really gain a tighter understanding of how rapidly consensus 
can be reached. Our attempt here is to provide a consequent step toward integration of the temporal 
aspects of information transit. We are thus led to further elaborate and exploit tools for description of 
the connectivity emergence in the communication graphs. 

Our purpose in this paper is to provide several criteria to estimate quantitatively the contraction rate 
of a set of agents towards consensus, in a discrete time framework. Using the language of dynamical 
system, the problem is here of estimating the second largest Lyapunov exponent of an infinite product of 
matrices (see also [B] for links with some joint spectral radius). To the best of our knowledge, previous 
results are centrally based on the existence of a lower bound of the nonzero entries associated to such 
matrices, and most of them on the existence of self-loops, see [5] and the surveys in [SJ HI] (see however 
the contributions in [311 [32] where the assumption on self-loops is relaxed) . Recently, A. Nedich et al. [28] 
proposed improved bounds under similar assumptions. On the contrary, we attempt here to follow more 
closely the spread of the information over the agent population, along the one or more spanning-trees. 

Ensuring a lower bound to the matrix entries of the agents already attained by the information flow 
along the spanning-tree, rather than all the nonzero contributions as classically, permits to obtain tighter 
estimates with weaker assumptions. The setting used here applies indifferently to leader-follower or to 
leader less networks. 

More precisely, the main idea is to examine the birth and rise of spanning-trees in the network. 
Distinguishing between different sub-populations, of agents already touched by spanning-tree and of 
agents not yet attained, and using lower bounds on the influence of the former ones on the latter ones, 
one is able to establish rather precise convergence estimates. Due to the nature of the assumptions, the 
latter possess some innate robustness with respect to parametric uncertainties. 

The paper is organized as follows. The problem is formulated in Section [21 and some pertinent 
concepts are therein introduced. Specifically, several appropriate connectivity notions are defined, among 
which sequential connectivity, which turns out to be central to our developments. The remaining Sections 
are devoted to the statement and demonstration of the main results. Section [3] deals with the problem of 
contraction estimates when information follows a single spanning-tree (or at least one such spanning-tree 
with a certain guaranteed strength exists in the underlying graph). This section contains remarks on 
self-loops and delays, see Subsection 13.31 The most original results are in Section^ where it is shown by 
means of a fairly general technique, how multiple spanning-trees can be used to derive tight estimates of 
the contraction rate. Last, conclusions are reported in Section^ 

For better readability, various examples are reported in the text, to illustrate the application of the 
results and to demonstrate the powerfulncss of the method. Also, some involved results and proofs have 
been put in Appendix. In particular the main technical tool for carrying out estimates over a finite 
horizon of the contraction rate of a linear stochastic system is given there. 

The authors wish to thank the reviewers and the Associate Editor for their penetrating comments, 
including the detection of a mistake in the previous version. 

Notation In the sequel, N stands for the set of natural integers (including zero), [^J designates the 
integer value of a real number x. For any set Af, we denote |7V| or card Af its cardinality. Generally 
speaking (Latin or Greek) upper case letters indicate matrices, and lower case letters are used to signal 
scalar numbers and vectors. Graphs and sets are distinguished by calligraphic letters. 

In the sequel, the (possibly infinitc-dimcntional) vectors 1 and lj denote respectively a column of 1 
and the vector with null components, except 1 in the i-th position. 

We call integer interval any set obtained as the intersection of a usual interval with the set N. When 
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the context is clear, in particular when talking about time values, the integer intervals are denoted as 
the classical ones: for example, [0,T] = {teN : < t < T}. 

For p, q positive integers, we denote as usual I p and pX g, the identity and zero matrices. The 
transposition of matrices is denoted T . By definition, (row) stochastic (resp. sub-stochastic) matrices 
are square matrices with nonnegative components, whose row sums are equal (resp. at most equal) 
to 1. Their spectrum is ordered by nonincreasing modulus magnitude: for M stochastic in R raxn , 
l = Ai(M) > |A 2 (M)| >...\X n (M)\. 

Last, we introduce the matrix sets M p > 9 . By definition, 

M p - q = {M G K pxq : M > and Vi = 1, . . . ,p, M iA + ■■■ + M uq > l} . (1) 

In and everywhere in the paper, matrix ordering is meant componentwise: M > stands for M,j > 
for all 



2 Sequential connectivity and other graph related notions 

We consider the problem of convergence of the consensus algorithm described by the following system: 

x k (t + 1) = 7fc,l (*)«!(*)> k e J\f , (2) 

toward a common value; that is, the global asymptotic stability of the diagonal set {x : Vfc, I G JV, Xk = 
xi}. As usual, ^ may be written in matrix form, as 

Mt)\ 

x(t + 1) = T{t)x(t), x(t) =1.1, r(*) = (7fe,l(t))(*,I)6>Vx^ • 

We consider scalar systems, although extension to multidimensional systems is possible. The set J\f is 
finite or countable, and the functions x^ map N to R. We assume in all the sequel that 

VM G W, Vi G N, Tfe,K<) > 0. and Vfc G N, 7fc,t(*) = 1 • ( 3 ) 

In other words, the matrices {'Jk,i(t))^j c ,i)eN'xN' are stochastic. 

Our goal in the remaining of the paper is to quantify the convergence speed of the set {xk (t) : k G TV} 
when t — > +oo toward a consensus value. We first introduce vocabulary adequate to measure the latter. 

Definition 1 (Agent set diameter). The quantity 

A(x(i)) = sup x k (t) - inf x k (t) 

is called the diameter of the agent set at time t. 

In what follows, A(x(t)) plays the role of a Lyapunov function to study convergence to an agree- 
ment. Although the latter depends upon the state, we frequently abbreviate the notation in A(t) if no 
misinterpretation is possible. 

Definition 2 (Contraction rate). We call contraction rate of system ([2]) the number p e [0, +oo] defined 
as: 

(A(ty 1 



sup limsup 

x(0) t-t+oo 



Va(o) 



The number p is indeed the second largest Lyapunov exponent of the dynamical system (p]). 
Some notions and definitions necessary to describe pertinent aspects of the communication between 
the agents are now introduced, based on some elementary tools of algebraic graph theory. 

Definition 3 (Communication graph). We call communication graph (of system ^ ) at time t the 
directed graph defined by the ordered pairs (fc, I) G Af X M such that 7/b,/(t) > 0. 
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In the present context, we use indifferently the terms "node" or "agent". 

Definition 4 (Neighbors). Given a graph A and a nonempty subset C C Af, the set Neighbors(£, A) 
of neighbors of C is the set of those agents k G Af \ C for which there exists at least one element 
I G C such that (k,l) G A. When C is a singleton {I}, the notation Ncighbors(7, A) is used instead of 
Neighbors({7},.4). 

A key property, namely weak connectivity, has been shown to influence crucially the evolution of 
finite systems of agents linked by time- varying communication graphs (see [251 127] , but also [5] , where 
the weakly connected sequences are called "repeatedly jointly rooted"). 

Definition 5 (Connectivity and weak connectivity). A node k G Af is said to be connected to a node 
I G Af on a directed graph A defined on Af, if there exists a path joining k to I in A and respecting 
the orientation of the arcs. Given a sequence of directed graphs A(t), i € N, the node k G Af is said 
connected to the node I G Af on an integer interval / CN if k is connected to I for the graph Ute/"^^) - 
A graph A is called weakly connected |25j if there is a node k G Af connected to all other nodes 
I G Af. A sequence of graphs A{t), t £ K, is called weakly connected across an integer interval / CN if 
the graph lJ t6J A(t) is weakly connected (that is, if there is a node connected across I to all other nodes). 
A subgraph connecting an agent to all the other ones is called a spanning-tree. 

The fundamental result found by Moreau states that uniform global asymptotic stability of the set 
of common equilibria is equivalent to the existence of an integer T > such that the sequence of graphs 
is weakly connected on any interval of length T [27] . Exponential estimates may be obtained too, 
see the survey part of [SlUHj, and [HI IE]- As a matter of fact, there is no specific difficulty to check the 
validity of both these results, with the weaker assumption that the graph sequence is weakly connected 
on every integer intervals [t p ,t p +i], p G N, where the t p define a strictly increasing sequence such that 
limsup p _ t+00 t p+ i -t p <T. 

In order to obtain more precise estimates of the decay rate toward consensus value, it is reasonable 
to introduce some minimal time taken by the information to cover the graph — while the preceding 
connectivity notions were not concerned with the ordering of the arcs constituting the tree. We thus 
introduce in the sequel some notions useful to quantify the minimal time for information spread. The 
latter play a central part in the contraction rate estimate to be stated later. 

Definition 6 (Sequential connectivity of finite graph sequences). A finite sequence of T graphs with 
common nodes A\, A2, ■ ■ ■ , At (T G N) is said to be sequentially connected if there exist a node k G Af 
and iterations given by: 

Af Q = {k} 

Af t C Aft-i U Neighbors(A/" t -i, A t ) t = 1, . . . , T 

which satisfy Afr = Af. 

When we want to emphasize the "root" node, we denote Aft by Aft(k), meaning that the iteration 
departs from node k. 

The sets introduced in Definition [6] are crucial to understand the principle of the method developed 
in the present paper. For each t = 1, . . . , T, the set Aft contains agents already in Aft—i and agents having 
a neighbour in Aft— 1 at time t: they are all agents which have been attained at most at time t by the 
settling of the spanning-tree rooted in k. 

We now introduce a derived notion for infinite sequences of graphs. 

Definition 7 (T-sequcntial connectivity). An infinite sequence of graphs A(t), t G N, is said T- 
scqucntially connected if there exists a strictly increasing integer sequence t p , p G N, fulfilling 

limsup t p+ i — t p <T (4) 

p — >+oo 

and such that each graph sub-sequence 

A(t p ),...,A(t p+1 - 1) 

is sequentially connected. 
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Remark that the property is by definition monotone with respect to T, viz. 

T-sequential connectivity =>■ (T + l)-sequential connectivity. 

Moreover, T-scquential connectivity is invariant with respect to finite time shifts, namely A{t) is T- 
sequentially connected iff for all g€N, A(t+q) is again T-sequentially connected. Similarly, T-sequential 
connectivity is invariant with respect to deletions and/or substitutions of finitely many graphs in a 
sequence, thus confirming that the property is truly an asymptotic definition. 

Notice the proximity of the definitions of sequential connectivity proposed here, with the notion of 
weak connectivity; the central difference being that the former one takes into account explicitly the time 
scheduling of the information transit. The following result links the different connectivity properties 
defined above and provides mutual bounds between the different connectivity time constants. 

Proposition 1. Any T-sequentially connected sequence of graphs is weakly connected on the integer 
intervals [t p ,t p+ {\, p G N. Reciprocally, given an increasing sequence t p fulfilling ([4]) ; any sequence 
of graphs defined on a set of n agents that is weakly connected on the intervals [t p ,t p+ i], p £ N, is 
(n — 1) 2 T -sequentially connected. 

Proof. The first statement is straightforward. We show next the converse part. For each p in N, let h p 
denote any of the agents connected to all the other ones over the union of graphs -^W ( sucn an 

h p always exists because of weak connectivity). Consider the sequence h p , hp+i, . . . ft. p +(„-i)2_i (of length 
(n — l) 2 ). Since (n — l) 2 = (n— l) + (n— 2)(n— 1), it becomes obvious that at least one agent appears (n— 1) 
times or more along the above sequence. Let us denote this agent by k and [t Pi ,t Pi +i], I = 1, . . . ,n — 1 
the corresponding time intervals. Remark that for large enough i, \t p ,t p+ ( n _iy] C [t p ,t p + (n — 1) 2 T], 
due to flU). 

Define Af tpi , I = 0, . . . , n - 1, by Af tpo = {k} and 

Mp I+I = M„ U {f 6 AT : 3t = 1, . . . , t pi+1 - t pi , Neighbors^', A(t pi + t)) n N tpi + 0} . (5) 

The set Mt VQ being a singleton, it suffices to show that the sequence Aft p is increasing, in order to deduce 
that |A* p | = n = \Af\, and so Aft p = N '. The latter property will then imply the existence of a 
sequential spanning-tree in [t Po ,t Pn _ 1 ] (included in [t p , t p + (n— 1) 2 T] for large enough i), and consequently 
the claimed proposition that the sequence of graphs is (n — l) 2 T-sequentially connected. 

Let I £ {0, 1, . . . , n — 1}, let us thus establish that J\f tpi C Mt Pl+l , provided that J\f tp[ ^ Af. By 
assumption, agent k is connected (non-sequentially) to all other agents at least on the n — 1 different 
time integer intervals [t pi , t pi+1 \. Thus, there exists t € {1, . . . , t pi+1 — t pi } such that the graph A(t pi + 1) 
contains a link originating in Aft p and terminating outside. This implies that, for this value of t, 
Neighbors(/', A(t pi +t)) n Aft Pt 7^ 0- In view of ([5|), one thus deduces that Nt Pl £ ■A/"t PJ ± - This achieves 
the proof of Proposition [T] □ 



3 Propagation of a unique spanning-tree 
3.1 Estimating the contraction: a key lemma 

A first result is now given, describing the elementary mechanism which permits to quantify contraction 
along a unique spanning-tree. 

Lemma 2. Let the finite sequence of communication graphs .4(0), . . . , A(T — 1) of system (|2|) be sequen- 
tially connected, and let Ao, . . . , N't be the sets corresponding to the spanning-tree (see Definition^. 
Assume that, for any t = 0, . . . , T — 1 and any k € Af, 

k € Aft+i ^ ^ 7k,i(t) > a(t) , (6) 
for a given map a : [0, T — 1] — > [0, 1] . Then 

A(T)< M- JJo(t)J A(0) . (7) 
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Besides sequential connectivity, it is thus assumed in Lemma [5] that, when an agent is in Aft+i (and 
thus is attained by the spanning-trcc at most at time t + 1), then at time t the total weight in the right- 
hand side of ^ of its neighbours from Aft (which have been previously attained by the spanning-tree), 
including possibly itself, is at least a(t), until completion of the tree. This is thus an hypothesis on the 
relative value of the two "feeding weights" , internal and external to the spanning-tree. 

Proof of Lemma® Lcmma[2]is a particular case of a more complex result, Lemma[!|l which will be used 
and demonstrated further. For this reason, we limit the present proof to the essential arguments. For 
any k € A/j+i we have 

Xk(t + 1) = J2 TM (*)*!(*) = T*,i (*) + lkd(t)xi(t) , 

i=l,...,n l€AT t l£j\f\J\f t 

where by assumption J2ieM t W — a W an< ^ Si=i n 7m(*) = 1- From this, it may be shown that 
max Xk(t + 1) < a(t) max Xk(t) + (1 — a(t)) maxec/^i) , 

and opposite inequality for the corresponding min expressions. Denoting 

Ai(i) = maxXkCt) — min xu(t) , 

it turns out that Ai(0) = (Ao is a singleton, the root of the spanning-tree), while Ai(T) = A(T) 
(when the spanning-tree has run entirely the graph, at time T). Thus 

A(T) = Ai(T) < (1 - a(0)a(l) ...a(T- 1)) A(0) 

as claimed in the statement. □ 

Remark 1. Under the hypotheses of Lemma [21 one may show easily that x(T), considered as a function 
of a;(0), verifies: 

*<^£1 all <"<<>■ < 8 ) 

where by k is denoted the index of the root of the spanning-tree. Indeed, one has more generally, for 
any t = 0, ...,T- 1: 

V/GM+i, >a(0)a(l)...a(t) . 

From ([5]), one deduces that, for any I G TV, 

T-1 

xi(T) = J] ait) x k (0) + Ci,i'(0,T) Xll (0) , 
t=o I'&N 

where the integers Q t i/(0,T) are nonnegative and such that, for any I G M, the weight of the remaining 
influences verifies: 

T-1 

^Cm'(o,t) = i- IJ«(*) ■ 

i'eAA t=o 
It is then immediate to establish that 

(T-1 \ T-1 

1 - J] «(*) mWO) < miyx,(r) - J] a(t) x fe (0) 
(=0 / t=0 

T-1 / T-1 \ 

< maKi(T) - a(t) x fe (0) < 1 a(i) 
t=o \ t=o I 

which furnishes an alternative proof of inequality (0) • One can thus interpret Assumption © as ensuring 
a minimal guaranteed influence of the value of x k (0) (at the root of the spanning-tree) on every value 
xt(T),l€Af. □ 
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3.2 Results on contraction rate estimate 

The main result of Section [3] is now presented. Direct consequence of Lemma [51 it provides an estimate 
of the contraction rate. 

Theorem 3. Let the sequence of communication graphs of system ([2|) be T -sequentially connected. Ac- 
cordingly, denote t p the corresponding increasing integer sequence of spanning-tree completion (see Defini- 
tional; Af p ,t-t p! t = t p , tp+1, . . . , t p+ i, the sets corresponding to the spanning-tree connecting sequentially 
the graph sub-sequences A(t p ), . . . ,A(t p+ i — I), p £ N (see Definitional; and T the corresponding set 

T={(p,t) : P eN,te{tp,...,t p+1 -i}} . (9) 

Assume existence of a map a : T — ► [0, 1] such that, for any (p, t) £ T , for any k £ Af , 

k £ Afp,t-t p +i => ^.'(*) - a M ■ ( 10 ) 

leN p ,t-t p 

Then the contraction rate of system ([2]) as defined in Definition® verifies: 

V ( V + !" 1 \ 1/t? + 1 

p<hmsup TT I" a iP'^) ■ ( n ) 

*~+°° P >=i \ t=t p , J 

Notice that, with the definition adopted in ©, there is indeed, for each t £ N, a unique p £ N such 
that (p, t) £ T. 

An important feature is that self-loops {"fk,k > 0) are not mandatory here, contrary to other previous 
contributions, see [SJHTlEj. This assumption is loosened up in [311 132] f° r some, but not all, agents. 
Example [3j below presents an example where this is further weakened. In particular, this feature permits 
to model leader/follower evolutions as well as leaderless networks within a unified framework. On this 
subject, see also Subsection 13.31 below. 

Similarly, no positive uniform lower bound on the nonzero coefficients of T(t) is required: requirement 
(jTUJ) is sensibly weaker than the usual one in the literature, see 0EJ12H] and Example [T] in the sequel. 

Proof of Theorem [3] One first states a monotonicity result for the diameter of the agent set along the 
solutions of ([2|). 

Lemma 4. For any trajectory of ([2]), one has, for any t £ N, 

A(t + 1)< A(t) . 

Proof. The proof of Lemma [H comes from the fact that, the matrices T(t) being stochastic, the map 
1 1 — ► sup feeA f Xk(t) (rcsp. 1 1 — ► inffcgjv' %k(t)) is non-increasing (resp. non-decreasing). □ 

One deduces directly from ([7]) that 

p / v+i- 1 \ 
A(t p+1 )< J] 1- II aOA*) A(fx). 

p'=i V v / 

Thus, 



limsupeVt-i v *m J = ii msu p e Vn ln { m ) e Vn m \ A d) ) < limsup jj [ 1 a(p',t) 

" P '=i 



Clearly, 

l l n f A(t P+ l) N ) l, /A(tn 

limsupe t i>+ 1 v A<0) ' < limsupe* m U( 0) J 

p — ' + OG t — '+OG 
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Now, from the fact that A(i) is nonincreasing and t p+ \/t p+ 2 —> 1 as p — > +00 one gets 

1, fA(t)\ 1 l n ( Mt P+^ \ 1 l n f A(t P+i ) S l 

limsupe* W < limsupe*p+ 2 v A<0) > = limsupe'f+ 1 v A<0) > 

t — »-foo p — >+oo p — >-(-oo 

(notice that the logarithmic expressions are not positive, due to the non-increasingness of A along time). 
The conclusion is then immediate from the definition of p given in Definition [2J □ 

The next result is a specialisation of Theorem El for constant a. 

Corollary 5. Let the sequence of communication graphs of system ^ be T -sequentially connected. 
Assume the existence of a constant map a in [0,1] satisfying (110p . Then 

P<(l-a T )± . (12) 

The previous results extends similar estimates found previously (see El El HHj ) , as a does not have 
to bound from below the components of the matrices T(t). 

Proof of Corollary® Assume without loss of generality t p+ \ — t p < T for all p G N. Consequently 
limsup p _ >+00 pT/<p_ ) _i > 1. Applying Theorem [3] with constant a yields for every p G N: 



p < limsup Yl (1 - aV+i-V) 1 ^ 1 < limsup [] ((l - a T^/ T \ T/t " +1 

limsup ((l-a^) 1/T ) PT/tP+1 <(l-a T ) 1/T 



p — 1 p — 1 

p — >+oo 

where one has used the fact that T 1— > (1 — a T ) is increasing on R + , for any a G [0, 1]. Corollary [5] is 
thus proved. □ 

Remark 2. A classical topic in linear algebra is the estimate of the second largest eigenvalue (in modulus) 
of a stochastic matrix for large dimensions. In particular, as n grows, Landau and Odlyzko |21j showed 
that the rate of convergence is of order 1 — l/n 3 (with n being the number of agents) for the equal 
neighbor time invariant model on undirected graph; see also results of the same nature in [29] ■ Our 
results can be applied to large systems as well. In particular, each given topology induces some kind 
of relation (typically an inequality) between tree-depth, weight of edges and number of agents. This 
inequality can, in principle, be used to derive convergence rate estimates based on the number of agents. 

We now provide several examples of systems with n = 3 agents, in order to illustrate the two previous 
results. 

Example 1. As a first example, consider the stationary system with n = 3 agents given by: 

A/3 1/3 

r = r(e) = 1/3 1/3 
\l/3 2/3- 

for fixed e G [0,1/3]. For e = 1/3, we obtain the equal neighbor averaging model corresponding to 
complete graph . Spectral analysis argument shows that the actual value of the contraction rate p is 
equal to 1/3 — e. Taking into account the fact that the coefficients are greater or equal to min{l/3, 2/3 — 
e,e} = e, methods in [21 El ES] yield an upper estimate of p equal to 1 — e 2 , or even 1 — e > 2/3 (taking 
into account the fact that the system under study is neighbor shared E] and adapting Lemma 2 
and Theorem 1] to systems whose nonzero coefficients are at least e). Now, Corollary \5\ can be applied. 
Indeed, the system appears as 1- sequentially connected — as the first node participates with nonzero 
weight to the evolution of all the agents — , and one can take a = 1/3 as a lower-bound for these 
weights. This gives an estimate of p equal to 2/3, which is better than the results obtained by the other 
methods. □ 
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Example 2. Consider a system with n = 3 agents and dynamics defined by ((2) with 



r(t) 



a(t)Mi(t) 



1 if £ € 2N, f(i) 



a(t)M a (t) 



if t e 2N + 1 



(13) 



Here, a : N — > (0, 1], M x : N -> M 2,1 , M 2 : N — > M 3 ' 2 (these sets have been defined in Q), and the 
stars stand for any nonnegative scalar numbers rendering the matrix r(i) stochastic (for this to hold, 
the row-sums of M±(t), M^ify have to be at most equal to o<(i) _:L ). 

What is meant here is that for even t, x\(t) participates with a weight at least a(t) to the value of 
X\(t + 1) and X2(t + 1); and that for odd t, X\(t) and X2(t) participates with a global weight at least 
a(t) to the value of x\(t + 1), X2(t + 1) and xs(t + 1). This is precisely the assumptions needed to apply 
Theorem [3 as detailed now. 

Taking the first component x\ as the root of the spanning-trcc, one sees clearly that this system is 
2-sequentially connected. Application of Theorem [3] then yields the following estimate: 



max < max xAt') 

t'=2t,2t+l 1 1=1,. ..,3 



min Xi(t) 

2= 1 .... ,3 



< (1 - a(0)a(l)) . . . (1 - a(2t - 2)a(2t - 1)) mas i,(fl)- min Xi(0) 

\i=l,...,3 ..,3 

valid for any t € N. When a is constant, Corollary [5] applies, and leads to: 

max Xi(t) — min Xi(t) < (1 — a 2 )^ 5 ^ I max Xi{0) — min Xi(0) ) . 

i=l,...,3 i=l,...,3 yi=l,...,3 z=l,. ..,3 J 

The following numerical experiment has been achieved. A set of one thousand couples of stochastic 
matrices T(l) and T(2) are generated randomly (uniform law on [0, 1] is used for each coefficients, and the 
rows are afterward normalised), and the best estimates for a(l),a(2) fulfilling the conditions above are 
then computed. The actual contraction rate p (which is the square-root of the maximal absolute value 
of the second largest eigenvalues | A2 (r(2)r(l)) | , see Proposition 1]) is then compared to the upper 
bound p deduced from Theorem [3] (that is y/l — a(l)a(2)). The corresponding histogram is represented 
in Figure [TJ □ 
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Figure 1: Numerical test of Theorem[3J Number of occurrences per value of the ratio pjp. See Example 
[2] for details. 



Example [2] shows that, although not tight, the bound may provide reasonable estimates. Notice 
however that the previous comparison test is achieved only with 2-periodic systems (characterised by 
the second eigenvalue A2(r(2)r(l))), although Theorem [3] requires no specific assumption on the general 
time dependence. An attempt to take into account the occurrence of several spanning-trces is proposed 
below (Section H|). 



Example 3. We consider here a simple 2-periodic 3-agent system whose evaluation is not possible by 
the methods presented by previous works. For t G N, we let 

(1/2 1/2 0\ / 1/2 l/2\ 

r(2f) = 1/2 1/2 , r(2* + 1) = 1/2 1/2 . 
\ 1/ \ 1 / 

The matrices T(2t + 1) being deprived of any self-loop, the criteria from [SJ [571 IS] cannot be applied. 
Considering that the system is 2-sequentially connected (with Afp = {1}, J^t\ = {1>2}), use, as in 
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Example^! of Corollary with a = 1/2 yields an estimate of the contraction rate as (1 — 1/4) 1 ' 2 , that 
is -s/3/2 — 0.87. Indeed, the present example is an instance of Example with a = i in (fT5|) . On the 
other hand, using as previously the second eigenvalue argument [H] of the product T(2t + l)T(2i), the 
actual rate is found equal to \/5/8 ~ 0.79. This value is smaller than \/3/2, but it is computed under 
the restrictive hypothesis of periodicity. □ 

Example 4. As a last illustration of Theorem[3l an elementary time- varying 2-agent system is provided, 
for which no uniform-in-time lower bound on the nonzero coefficients of the state matrices exists. This 
is a situation excluded from the previously published criteria. Let 

/l 0\ /0 1 0\ 

T(2t) =1 , r(2t+l) =1 1. 

This is clearly another special instance of Example [2J Theorem [3] applies with a = 1, and yields a 
null contraction rate. Indeed, finite-time convergence does occur, as 

/l 

r(2*)r(2* + i) =100 

\1 

□ 




3.3 Remarks on self-loops and delays 

As noticed previously, self-loops are not assumed in the previous results. However, it is a well-known 
fact that their absence may lead to non-convergence, as shown e.g. by the elementary example 

xx(t + l)=x 2 (t), x 2 {t + l)=x 1 (t) 

whose solutions are either constant or oscillating, although the system is undoubtedly sequentially con- 
nected. 

In fact, the assumptions of the main result of Section [3l Theorem HJ force the existence of a self- loop 
on the root of the spanning tree at each t — t p , p £ N. This unique self-loop, together with the other 
hypotheses (which impose rather information flux from upstream), turns out to be sufficient to enforce 
the convergence. A similar remark will hold for the forthcoming results on systems with several spanning 
trees given below (see Section^ especially Thcorcm[7|). This is a crucial point, as it drastically conditions 
the search for spanning-trees. 

On the other hand, it is quite evident that the information transfer between the agents may be subject 
to delays. This feature does not present specific difficulties a priori, because it can be treated the same 
way, via an augmentation of the state vector. Some past state values are then included in the definition 
of the diameter and of the contraction rate which are considered (see Definitions [T] and [2]) , but this has 
essentially no consequence on the meaning of this latter quantity. 

Generally speaking, delays cannot suppress sequential connectivity, except if they concern the unique 
mandatory self-loop, located at the root at the initial time instant (see above). On the other hand, they 
may change the values of the weights a(t) and thus modify the decay estimates. Also, it is rather likely 
that the decay rate estimate are nondecreasing with respect to any delay. 

A more precise study of the quantitative influence of the delays on the convergence speed could be 
tackled by similar tools, this feature is out of the scope of the present paper. For simplicity, we limit 
ourselves to a simple example, for which analytical results are easily computed. 
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Example 5. Consider the four following systems: 

x 1 {t + l) = ^x 1 {t) + -x 2 (t), x 2 (t + l) = ^xt(t) + -x 2 {t) ; (14a) 

x 1 (t + l) = ^x 1 (t) + -x 2 (t), x 2 (t + l) = \xi{t- l) + -x 2 {t-l) ; (14b) 

xi(t + 1) = -x x {t) + ^ Xl (t - 1) + ^x 2 {t), x 2 (t + 1) = - 1) + ^x 2 (t) ; (14c) 

xi(t + l) = ^i(t-l) + i.T 2 (t), « 2 (*+l) = ^a:i(t) + ia:a(t-l). (14d) 

The delay-free system (|14ap is 1-sequentially connected, and the analysis conducted above yields the 
estimate p = ^ > p = 0. 

The three remaining systems possess delayed terms x\(t — 1) and x 2 (t — 1). Introducing Xs(t) = 
X\(t — 1), x^(t) = x 2 (t — 1), they can be written x(t + 1) = Tx(t) where x = (xi, x 2l X3, x^) 7 and 
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respectively for (|14bp . Q14cp and (|14dp . System (|14bp is 3-sequentially connected with a(0) = a(l) = 
a{2) = i, so that p = ~ 0.96 > p = \. System (|14cp is 2-sequentially connected with a(0) = \ and 
q(1) = i, and p = ~ 0.94 > p = i. Last, system (|14dj) is not sequentially connected, due to the 
absence of self- loop (zero diagonal). This is corroborated by the fact that p = 1, so convergence does 
not occur. 

As can be seen, the index of sequential connectivity is not systematically the sum of this index for 
the delay- free case (1 here) and the sum of the values of the delays. 

4 Communication graphs spanned by several spanning-trees 
4.1 Sequential connectivity with several spanning-trees 

When several spanning-trees emerge in the communication graph (either simultaneously, or successively), 
the previous analysis may happen to be conservative. We now face the issue of how to tackle this feature. 

An extension of the notion of sequential connectivity introduced in Section [2] is first constructed, 
analogously to Definitions E] and [7] 

Definition 8 (Sequential connectivity of finite graph sequences by multiple spanning-trees). A finite 
sequence of T graphs with common nodes A.\, A. 2 , . . . , At is said to be sequentially connected by m 
spanning-trees (m € N) if there exist nodes k 1 , k 2 , . . . , k rn G Af and iterations given by: 

K = 

A/"/ C U Neighbors (A/"/l x ,A t ) t = 1, . . . , T 

satisfy = Af for all j G I = {1, 2, . . . , to}. 

Similarly we define the property for infinite graph sequences: 

Definition 9 (T-sequential connectivity by multiple spanning-trees). An infinite sequence of graphs 
A(t), t G N, is said T-sequentially connected by to spanning-trees if there exists a strictly increasing 
integer sequence t p , p G N ; fulfilling ^ and such that for all p G N, each graph sub-sequence 

A(t p ),...,A(t p+1 - 1) 

is sequentially connected by m spanning-trees. 
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The following result extends Lemma [5] As the latter, it is directly deduced from Lemma so detailed 
proof is omitted. 

Lemma 6. Let the finite sequence of communication graphs *4(0), . . . , A(T — 1) of system @ be sequen- 
tially connected by m spanning-trees, and let Afg , . . . ,Af^ be the sets corresponding to the j-th spanning- 

tree (see Definition^. For each k G Af, con sider sets Aff' J C Af] such that j ^ f => Af t feJ n Af?' 3 = 0. 
Assume the existence of maps onj : [0, T — 1] — > [0, 1] suc/i £/ia£ ; /or any t = 0, . . . , T — 1, any i, j el 
and any fc G A/", 

fceA? +1 4 ^ 7fc> ,(t) > OijW , (15) 

for given maps otij : [0, T — 1] — > [0,1]. T/ien A(f) = (c^.j (t))(i,j)ezxx * s a sub- stochastic matrix in 
M mxm and 

A(T) < f 1 - max -!)••■ ^(0)1^ A(0) , (16) 

where 1 and lj have been defined in the Notation section. 

The sets A7 generalise the notion introduced in Section [3J here, each set A/"/ is constituted by agents 
attained at most at time t by the j-th spanning-tree. Assumption (|15p fixes a lower bound cti j to the 
total weight applied by each agent in A/^ +1 to agents in A/j? . 

When an agent is member, for given t, of sets A/"/ for more than one value of j, it is necessary to 
decide, in the construction of contraction estimates relative to the Xk update equation, to which of them 
its influence is attributed; this choice could actually vary according to the considered update equation. 
This is the reason why subsets Af t ' 3 disjoint for different js are introduced. 

Remark 3. When in the statement of Lemma [S] the sequential spanning-trees corresponding to two dis- 
tinct values of i, %' are identical, then the scalar quantities 1JA(T — 1) . . . ^4(0)1 and 1J/^4(T— 1) . . . ^4(0)1 
are equal — at least if the a,j (t) are chosen identical for all j G T. 

On the other hand, different choices in the attribution of arcs to one or another of the m developing 
spanning-trees (that is on the definition of the sets A/" t fe ' J ' ) may lead to different choices for these coeffi- 
cients, and consequently to different estimates. In this respect, adding virtual sequential spanning-trees 
may allow to improve the convergence speed estimate, see Example [5] below. □ 

Remark 4. As in Remark \T\ for Lemma [21 one shows easily that, under the hypotheses of Lemma [H 
one has similarly, for any j G I, 

V^AA,gg|> W -l)...A(0)l,, 

where the index k represents any index of the roots of the m spanning-trees. Indeed, for any t = 
0, . . . , T — 1 and any j G I, 

WejV k' ^^21 >1}A(T-1)...A(0)1, , 
which gives the previous estimate when t = T — 1, as A/j. = Af for all j G X. □ 



4.2 Results on contraction rate estimate 

We now come to the key result of Section 31 which is also the most powerful of the paper. 

Theorem 7. Let the sequence of communication graphs of system @ be T -sequentially connected by 
m spanning-trees. Accordingly, denote t p the corresponding increasing integer sequence of spanning-tree 
completion (see Definition^; Af pt _ t , t = t p , . . . the sets corresponding to the m spanning-trees 

connecting sequentially the graph sub-sequences A(t p ), . . . ,A(t p +i — 1), peff (see Definition^); and 
T the set defined in Furthermore, for each k £ Af, consider sets Af'l_ t C Af pt _ t such that 
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j f =>• ]\[ p $_ t r\N p 'J-t p = 0> an d assume the existence of maps cii_j : T — > [0,1], (i, j) G I x 1, suc/i 
i/iai, /or any {p 1 1) G T, any i, j G I and any fc G TV, 

fc G ^, t _ t , +1 > aij(p,t) • (17) 

Then A(p,t) = (aj.jCp, i))(jj)ezxz * s a sub-stochastic matrix in R mxm and £/ie contraction rate of 
system ([2|) as defined in Definition® verifies: 

p / \ i/tp+i 

p < limsup TT I 1 - max t p >+i - 1) . . . A(p', . (18) 

p^+oo pl=1 \ j ex J 

Proof of Theorem® Due to the fact that the sets Mkj(t) are pairwise disjoint for different values of j, 
one has, for any i G T, any t G N, 

£«u(p>*-*p)<X! E 7fc,i(*)<Z)7fc I l(*) = l. 
jez jeiieAfkjit) leM 

for any fc G Af p t _ tp+1 . This proves the first part of the statement. 

As in the proofs of Theorem [3] above, it suffices essentially to establish (fT6|) when t is a multiple 
of T. Applying Lemma H on the integer interval \t pi t p+ {\ with Mi(t) = N pt _ tpl Mk,j{t) = Af p £_ t , 
Cij(t) = a itj (p,t) yields: 

A t (t p+1 ) < IT - 1) . . . A(p,t p )A N {t p ) + A( P ,t p+1 - 1) . . . A(p,tp)l) A(t p )j . 

Here, the definition of A_/v depends upon p and is as follows: 

/Ai(*r 



A/v(t) = 



Ai(t) = max Xfc(i) - min i = i p , . . . , t p+ i . 



\A m (t) 

By assumption, the existence of the m spanning-trees means that: 

Ai(t p ) = and Ai{t p+1 ) = A(t p+l ), iel . 
One thus deduces that, for all igl, 



A(t p+1 ) = Ai(t p+1 ) < IT I 1 - A(p, tp+i - 1) . . . 4(p, A(t p ) . 

Thus, 

A(t p+1 ) < (1 - lji4(p, i p+1 - 1) . . . A(p, tp)l) A(*p) . 
The proof is then achieved as for Theorem [31 □ 

Example 6. We come back to the analysis of Example [l] now with the help of Theorem [7] One may 
distinguish three spanning-trees occurring on each time interval of unit length (in other words, the system 
is 1-scquentially connected by 3 spanning-trees), with root at each of the agents. With this point of view, 
X = J\f = {1, 2, 3} and t p = p. With the notation of Theorcm[7J one may put: 

A;I,, {j}, ^=^ = {1,2,3}, fori = 1,2, 3. 

This is the simplest case, where the sets Af p are pairwise disjoint, so one takes 
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We now form the functions ctij as defined in the statement of Theorem [JJ and the corresponding 
matrix A. By definition, one should have for any i,j <E {1, 2, 3} (see (jTTJ)) : 

Vfc g {1, 2, 3},Vp e N, 7fcJ > ayfap) , 

where T = (7»,j)(»,j')exxx ^ s given in Example [JJ above. One thus takes 

ai,j(p,p)= min 7 fc j,i = 1,2,3, 

fc— 1,2,3 

that is: a* i = 1/3, 0^ 2 = min{l/3, 2/3 — e}, 0^3 = min{l/3, e}, or again 

/1/3 min{l/3,2/3-e} min{l/3,e}\ 
A =1/3 min{l/3,2/3-e} min{l/3,e} . 
\l/3 min{l/3,2/3-e} min{l/3,e}/ 

Applying then formula (|16|) leads to an estimate of the actual contraction rate equal to 
1 - (l/3 + min{l/3,2/3-e} + min{l/3,e}) = 1/3-e . 

In this example, the method ensuing from Theorem [JJ thus generates the exact value of the contraction 
rate p. 

Considering now only the two first spanning-trecs (with M p = {j}, A/^j = M = {1,2,3} for all 
p 6 N and all j £ {1,2}; then a^i = 1/3, 0^2 = min{l/3, 2/3 — e} = 1/3, i = 1,2) gives a worse 
estimate, namely 1/3. Similarly, considering the first and third, or the second and third, spanning-trees 
yields 2/3 — e. These estimates are different, tighter than 2/3, the value obtained in Example [1] when 
considering a unique spanning-tree, but not optimal. □ 

We refine further in the sequel the analysis of systems spanned by several spanning-trees, and ex- 
amine respectively in Sections 14.31 and 14.41 the cases of spanning-trees propagating consecutively and 
simultaneously. 

4.3 Application to systems with successive spanning-trees 

We now consider the case where the several emerging spanning-trees have common root and possess 
certain order property. We mean by this that the dates at which each spanning-tree reach an agent 
are interlaced independently from the agent. Otherwise said, the "wavefronts" corresponding to each 
spanning-tree spread in a conccntrical manner. Up to renaming, one may label 1 the first spanning-tree, 
2 the next one and so on ... , and the order property simply reads (reasoning on each interval [t p , tp+i], 
we omit the index p) : 

Vj, j' < / . .'/ / 1. ./• / A/f c Ml , 

and thus, by construction, the following inequalities hold, for any t G [t pi t p+ i\: 

A m (i) < •■■ < Aj-(f) < ■■•< Ai(t) . 

It is thus systematically more fruitful to attribute any contribution in the right-hand side of to 
the set Mi with largest index i to which it belongs — because the corresponding estimate is tighter. In 
particular, it is beneficial to choose Ojj = for i < j, thus leading to lower-triangular matrices A in 
Theorem [JJ 

We provide now an illustration of this configuration. 

Example 7. For a fixed scalar 7 S [0, 1], consider the time-invariant system of n agents described by 

x 1 (t + l) = x 1 (t), s i (t + l)=7aB i _ 1 (t) + (l-7)xi(t), i = 2,...,n. 

The corresponding matrix T is lower-triangular and admits, apart from 1, a unique eigenvalue, namely 
1 — 7, with degree n — 1. The actual value of the contraction rate is thus p = 1 — 7. 

For any positive integer q, one may consider that the communication graph is spanned by q distinct 
spanning-trees, departing from agent 1 at time 0, then 1, 2 and so on, up to q — 1, and attaining agent 
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Figure 2: Matrices A obtained in Example [7] (case n < q). 



n at time n — 1, n, up to n + (7 — 2. The duration of this process is thus T = n + q — 2, and the system 
may be seen as "T-sequentially connected by q (distinct) spanning-trees" . Coherently with the previous 
notations, we let t p = pT and consider the sets ACj t , i el = {1, . . . , q}, defined by: 

{{1} fori<0, 
{l,...,t+l} fort = 0,...,?i- 1, and ACj+ji = Af* >t for i = 2, . . . , q - 1 . 

{1, . . . , n} = M for t = n - 1, . . . , n + q - 2, 

Following the progression of each spanning-tree, one shows that one may take for A (in R 9X<? ) the formulas 
depicted in Figure [2] (see also in Appendix the details of the proof of Lemma [8] below). 

Let us explain these formulas. From t = to t = n— 1, the first spanning-tree spreads from agent 
1 to agent n; for the elements of the latter, the right-hand side of the state equation is composed by 
element already touched by the information flow (with coefficient 7) and some newly touched element, 
which consequently does not contribute to the right-hand side. We may therefore choose, Np'l = ACJ7 
and J\fpJ = for j = 2 ... q. This gives rise to the identities ai,i(i) = 7 and aij(t) = for j e X \ {1} 
for t = 0, . . . , n — 2. At time t = n — 1, one has JVp t = N and the expansion of this set is completed, 
so all the terms in the right-hand side come from inside Mp t . Thus, again by letting = N and 

Afpt = for t = n — 1, . . . , n + q — 3 and j = 2 . . . q, one has = 1 and ai t j(t) = 0. 

The second spanning-tree departs from the root at t = 1, therefore letting AC,' = Mp and AC q = 
yields a 2 ,2(*) = 1 and a 2tj (t) = for j £l\{2} for t = 0. Then at t = 1, A" p 2 t = {1} and A" p 2 t+1 = 
{1,2} = A/^ t U (Afpt \ Np t ). More precisely, the corresponding right-hand side comprises two terms as 
before: a contribution, with coefficient 7, due to agents already attained by the second spanning-tree, 
plus a term, with coefficient 1 — 7, due to a term coming from an agent not yet touched by the second 
tree, but already by the first one. We let Np'l = {2}, J\f p \ = {1}, A^'f = for j = 3 . . . q; this explains 
that for t = 1 one has: Qf2,i(i) = 1 — 7, Q<2,2(i) = 7 and «2j(^) = for j G X\ {1, 2}. Similarly, we define 
J\fpj = {t + 1}, A"p' t 2 = {1 . . . t} and AC,'/ = for i = 2 . . . n where the second spanning-tree in turn is 
completed. Again one obtains at2,i(t) = 1—7, a2,2(i) = 7 and o: 2 ,j(i) = for j G X \ {1, 2}. Then for 
subsequent i's, we let AC, t = A" and A' 2,1 ' = for j ^ 2. So that indeed «2 2 (£) = 1 and a 2 = for 

Last, the other spanning-trees appear one by one, and share with their predecessor the same relation 
than the second one with the first one. This explains the formulas given, until completion of the q-th 
one, at time t = T. The analysis conducted above leads overall to the matrices shown in Figured which 
corresponds to the case n < q (the first spanning-tree is completed at t = n, before the departure of the 
g-th spanning-tree, at t = q). The case n > q is similar. 

For the case of n = 3 agents, formula (flT)]) in Theorem [7] then yields the following estimates, denoted 

Pg- 

• for q = 1 (corresponding to the method of Theorem [5]) : 

A(0) = = 7 , 
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Figure 3: Approximations of the contraction rate as functions of 7, for different uses of TheoremO See 
text of Example [7] for details. 



so ~ Pl = A(l)A(0) = y/T^T*. 

• for q = 2: 



and 



p 2 = ( l-maxlTA(2)A(l)A(0)l 



for g = 3: 



) V3 = (1 - max{ 7 2 ; 3 7 2 - 2 7 3 }) 1/3 = (l - 3 7 2 + 2 7 3 ) 1/3 



'7 0\ / 7 0\ / 1 0\ /l N 

A(0) = I 1 ),A(1)= 1-7 7 ),A(2)= 1-7 7 J , A(3) = 1 
,0 01/ I 01/ 1 1-77/ VO I-7 7y 



whence: 



1/4 

P3 = (1- max 3 lIA(3)A(2)A(l)A(0)l 



= (1 - max{7 2 ; 3 7 2 - 2 7 3 ; 3 7 4 - 8 7 3 + 6 7 2 }) 1/4 = (l - 3 7 4 + 8 7 3 - 6 7 2 ) 1/4 



The values obtained approximates the exact value 1 — 7 with increasing precision, as seen in Figure 
[3] These successive improvements are of course consequence of a richer and richer analysis, including 
more and more settling spanning-trees. 

The question of the limiting behaviour when q goes to infinity is of course intriguing: is the exact 
value found asymptotically? It turns out that the answer is positive, as stated now in the general case 
of a system with n agents. 
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Lemma 8. The value of p q is given by the following formula: 



9-1 



pn+1-2 = ! _ 7 n-i £ (1 _ 7r 



n + i - 2 
n-2 



1 



dS n ~ 2 



fin+q-2 
1-5 



(5=1-7 



(n-2)! 

Consequently, p q tends towards p = 1 — 7 lo/ien g — > +oo, and more precisely 

/ „w„ . In g /hig 
p g = p+(n-2)(l- 7 )-^ + o(— * 

A proof of Lemma [5] is presented in Appendix. The calculations have been checked independently by 
the authors, using symbolic computation tool. 

Although presently limited to special class of examples, Lemma [5] is rather promising: it establishes 
that tight estimates may be accessed to, when employing large number of settling spanning-trces in the 
analysis. Extensions are in progress to cover more general cases. □ 



4.4 Application to systems with concomitant spanning-trees 

The example previously shown exploit drastically the fact that the different spanning-trees occur one 
after another. We show here that, otherwise, the techniques of Theorem[7]may provide deceivingly weak 
results. 

Example 8. To illustrate this, we consider a system with n — 6 agents, T-sequentially connected for 
T = 5. For fixed 7 € (0, 1/2), the latter is defined by taking stochastic matrices such that: 
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for all p £ N (thus t p = pT here). As in Example [31 the inequalities here are meant componentwise. 

The information transfers are schematised on Figure |U The agents are numbered with Arabic num- 
bers and the Roman numbers describe the different stages of the spanning completion. Only the com- 
munications with guaranteed coefficient 7 arc represented. For simplicity, the self-loops are omitted. 

Analysing the system with the use of a unique spanning-tree (Theorem [3]) yields: pi = (l — 7 3 ) 1 ^ 5 . 
To use Theorem [7] for analysis, one considers two spanning-trees and takes on any interval [t p ,t p+ i]: 

K,o = K,o = I 1 ). Ka = <i = {!. 2 }' 
{1,2,3}, Ml 2 = {1,2,4}, = {1,2,3,5}, A/£ 3 = {1,2,4,6}, 



AC, 



A^ i4 = {1, 2, 3, 5, 6}, Ml A = {1, 2, 4, 5, 6}, A£ 5 = AA p 2 5 = J\f 



and 



A(0) 



A(4) 



7 
7 



/ 7 o\ 

7 



7 



7 0/ 
(19a) 



(19b) 



The deduced estimate is p~2 = (l — 7 5 ) 1 ^ 5 . The important point is that it is systematically looser than 
the previous one. Indeed, the previous formula could have been obtained by taking into account only one 
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Figure 4: see text of Example [S] 



6' 5' 4' 3' 2' 1 2 3 4 5 6 
• • - • • • • • • • • - • 

V IV III II I I II III IV V 

Figure 5: see text of Example [5] 



of the two spanning-trees, say the "right branch", where the signal circulates in the order 1-2-4-6-5-3. 
Otherwise said, there would no difference in evaluating the graph similarly schematised, shown on Figure 

m 

How to take into account the crossing of the two spanning-trees, a case explicitly discarded in Section 
14.31 / A general idea is to introduce new "populations" . However, this is not so easy, as Lemma |H] is 
hardly adapted (it is here useful to recall that the diameter of the union of two sets is at most equal to 
the sum of the diameters of these two sets, if their intersection is non-void). 

Along these lines, one may propose an idea for improvement of p~2- Let 

J p,t J v p,t ^ J v p,i ■ 

This is just, in fact, the population considered in the one-spanning-tree method leading to p~\. We are 
then allowed to take: 

h o o\ h o i - 7\ 

A(0) = --- = A(2)= 7 , A(3) = A(A) = 7 1-7 • (20) 
\0 7/ \0 7 / 

As 

A(A)A{3)A(2)A(1)A(0) 

the estimate obtained via Theorem [7] is 

P3 = (l-7 4 (2-7)) 1/5 , 

which verifies p\ < < p~i for 7 G [0, 1]: actually, p^ does not overpass the precision of p\. □ 

A careful examination of the previous example shows why no improvement could be obtained: the 
diameters of the three sets arc equal up to the third stage, and the form of the difference inequalities 
involved forbid the two components fed with by the third one, to become larger than the latter. 

However, notice that this paradoxical behaviour is also resulting of the value of the coefficients. The 
next example indicates that the method proposed in Example [5] can indeed provide better estimates. 
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2(1- 
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Example 9. We consider a slight modification of Example[Hl For fixed r\ <E [0, 1], we take T as previously 
(see ((HI)), except 



T(pT+l) > 
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In other words, the transmission along the "left branch" in Figure 2] occurs with a least coefficient than 
along the right one. This modifies both the evolution of the diameters of A^ 1 and A^ 3 , and one now has 
to modify the values of A by taking 

frpf 
A(l) = A(2) = 7 
\0 V1J 

instead of those given in (|20j) . Using the notations of Example [5] yields the two contraction rate estimates 
P'l = (1 - ?/ 2 7 3 ) 1/5 and ~p' s = (1 - 7 4 ( 7 + 2r? 2 (l - 7 )) 1/5 . 

In particular, when 

n < 



(1 + 2 7 (1- 7 )) 1/2 



(a quantity located in [0, 1/3] for 7 € [0, 1/2]), then the p' 3 is smaller than the estimate p\, obtained by 
considering a single spanning-tree. □ 



5 Conclusion 

Several tools for estimating the convergence rate to consensus in multiagent systems were introduced and 
illustrated through simple examples. The criteria are based on topological as well as basic quantitative 
information. In accordance to previous results, consensus is reached provided that information can flow 
at least along some spanning tree from one agent to all of the others. A key quantity, in this respect, 
appears to be a lower bound on the total weight of the agents located upstream along the information 
flow for any chosen spanning-trcc. More general criteria are also provided in which tighter estimates are 
allowed, provided that more spanning-trccs arc simultaneously taken into account. 

These techniques are, in general, based on the idea of considering a decomposition of the overall 
population into subsets which influence each other in some quantifiable ways. Natural candidates for 
this partition appear to be the agents already attained by the information flows along the spanning-trees. 
There seem to be technical difficulties in trying to consider other kinds of partitions, as in general, neither 
the diameter of an union of sets, nor of an intersection of sets, is related to the diameters of the two 
sets. However, it may be possible to consider the set of agents attained by one ore more spanning-trees 
and then the set of agents attained in the reverse order. We leave this as an interesting open question 
for future research. 

The method presented here provides results which arc rather tight and inherently robust due to 
the qualitative nature of the assumptions involved. It is especially interesting to develop tools for 
quantitative estimates based on the consideration of simultaneous trees as arising from a single tree 
which gets repeated through time, as in Example [7] Again this will be topic of further investigations. 



A Appendix — Fundamental inequalities 

We state in the sequel a result on difference inequalities which is central to the techniques developed in 
the text. Consider the time- varying linear system ([2|). As before, the index set Af is finite or countable, 
the Xk constitute a collection of scalar functions defined on N, 2 is a finite or countable index set and, for 
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any t £ N, a collection of subsets Mi(t) of N, i £ X, is given. Also, the state-matrices (7fc,;(t)) (k,i)eN 'xW 
of the system are row-stochastic. Define the diameters: 

A(t) = sup Xfe(i) — inf Xk{t), Aj(t) = diam A^i(t) = sup Xfc(t) — inf Xk{t), 
kerf kert keM,(t) keMi(t) 

and the vector 

A M {t) = (diam M l {t)) l£l = {Ai{t)) iex ■ 
The following result provides informations on the evolution of the diameter vector. 
Lemma 9. Assume that for all k G J\f, for all (6N, some sets M-k,j(t)> j G X- are given, such that 

M k ,j(t) C M*(t) and n A^ fej v (t) ^ ^ j = / . 

Let maps Cij(t), i,j el, and C(t) be such that: 

Ci,j(t)< inf J] ?*.'(*)> C(*) = (ci.j(*))(M)eixi • (21) 

£ .A/1 i ii ~\~ 1 J 

Then, for any t, T £ N, /or any i G X, 

< A<(t + T) < 1] (c(t + T - 1) . . . C(t)A M (t) + (1 — C(t + T —1) ... C(t)) lA(t) j . (22) 



By convention, we put X)ie0 c « = ^ ano - m ^ «e0 c « = +°°- Recall that the vector 1 in the statement is 
made up of a column of 1 and that the vector 1^ has null components, except 1 in the i-th position (in 
finite dimension, it is the i-th vector of the canonic basis). In particular, lJAx(t) = Aj(t), 1 = 



Remark 5. Notice that formula (|22|1 may involve infinite summations in the products of infinite-dimen- 
sional matrices. As the coefficients of the matrices C{t) are nonnegative and bounded by 1, uniform 
convergence of the series of terms indeed occurs on any bounded time interval, therefore the notation 
has a uni vocal meaning. □ 

Proof. Define 

M{t) = sup £fc(t), Mi(t) = sup Xk(t), m(t) = mmx fe (t), mAt) = min x k (t) , 
keM k<£Mi(t) k ^ keMi(t) 

in such a way that the quantities previously defined in the statement verify: 

A = M - m, Ai = Mi - m, . 

First of all, notice that, due to the nonnegativity of the coefficients ~f k ,i{t), identity © implies, for 
any t £ N and for any k G J\f, 

x k (t + l) <J2^,l(t)M(t)=M(t) . 

Taking the supremum and arguing similarly for the lower bounds, we obtain: 

M(t+ 1) < M(t), m(t + l) > m(t) . 

In particular, 

A{t + 1) < A(t) . (23) 
Also, due to the fact that M.i(t) C Af, it comes: 

Mi{t) = sup x k (t) < sup x k (t) = M(t), mi{t) > m(t) , (24) 

k<£M z (t) keM 

and 

A t (t) < A(t) . 
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Applying tighter estimate, one obtains from that, for any k G Af, 

x k (t + l) = E Tfc,i(*)^i(*) + E 7fc,i(*M*) 

jeiieM k ,i(t) ieM\\j jex M kd (t) 

^ El E 7*,«(<)W*) + E 

jez VeAifc^W / ieAA\u jez M fcJ (t) 

= E E 7M(«W+(l-E E Tk,l(*)W), 

due to (|2"Tj) and the nonnegativity of the coefficients "fk,i(f)- If now fc G Mi(t + 1) for some i G I, one 
obtains: 

x k (t +i) < J2 ciMMM + 1 - E A/ w + E c =jW - E ->*,!(*) (M(t) - M 3 {t)) 

jez \ jez / jez \ ieM ktj (t) / 

< E c ^ (DM, w + i - E c ^ (*) M (*) > 

jez \ jez / 

due to the fact that M(t) > Mj(t) for any t £ N and any j £ I (see (f2"l|)). Consequently, for any i el, 

M<(t + 1) < ^ c^M^t) + i - E M (*) • 

jez \ jez / 

One establishes similarly that 

x k (t + 1) > X! c »jW™iW + 1 - E C *J'W m W ' 
jez \ jez / 

with the same coefficients, so, for any i G Z: 

m<(t + 1) > ^ ^(tjro^t) + 1 - E m W • 

jez \ jez / 

Subtracting the previous inequalities, one may thus deduce that, for any i G X, 

Ai(t + 1) < 2 + 1 - E A W ' 

jez \ jez / 

The collection of these inequalities, together with (|23p . may be written under the matrix (possibly 
infinite) form: 

'A M (t + 1)\ (C{t) 1 - C7(f)l\ /A^t^ 

A(<+i) ; - o i a aw 

The previous inequality has to be understood componentwise. 
Now, one shows easily that: 

[C(t +1) 1 - C(t + /(7(f) 1 - C*(i)l\ /<7(f + l)<7(i) 1 - C(t + l)<7(i)l 
I 1 A 1 7 I 1 

in such a way that, for nonnegative T, 

A M (t + T)\ < f(7(t + T-l)...<7(t) l-(7(t + T-l)...<7(i)l^ fA M (*) 



A(i + T) y - V 1 J \ A(i) 

This formula permits to complete the proof of Lemma [5] □ 
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B Appendix — Proof of Lemma [8] 

1. One verifies directly that, for any t = 0, . . . , n + q — 3, 

A(t) = I q - (1 - 7) \ S <t< n -i eie] + <5i< t <„ e 2 (e 2 - ei) T H h <J g -i<t<n+ 9 -2 e g (e 9 - e g _i) T ^ , 

where ej is the i-th vector of the canonical basis in R q and 5i<t<i+n-i is 1 (rcsp. 0) if the condition 
written in index is fulfilled (resp. violated). 

Let us first establish the following factorisation formula: 

A(n + q-3)... A(0) = 7""* diag{l; 7; . . . ; j^ 1 } B(n + q - 3) . . . B(0) diag^ 9 " 1 ; . . . ; 7; 1} , (25) 
where the matrix B(t) is obtained from A(t) by replacing 7 on the diagonal by 1, and 1 — 7 by 

7 

that is simply: 

9-1 

B(t) = J g + £ ^ ^<t<i+n-2 e l+ iej . 

i=l 

In formula (|2"5|) and below, diag is used to define diagonal matrices. 

Formula |25|) will be proved by induction on the positive integer q. Notice that strictly speaking, the 
matrices A,BG M. qxq depend upon q (and n), but for simplicity we omit here any explicit indication of 
this dependence. Indeed, for q — 1, A(t) — 7 for 0<t<n + q — 3 = n — 2, and A(n — 2) . . . A(0) = 7"" 1 ; 
while for q = 2, n + q — 3 = n . — 1 and 

^(0)=(j J), ^)=Ll 1 °),l<t<n-2, A(n-1) = (^ 7 °), 



A(«-l)...A(0)= 7 -(; ! ! ?)" n ?)=7- 2 (J ?>(n-l)...S(0)^ 



so that 

n-l 

(Notice that 5(0) = 7 2 and = Q for f = 1, . . . , n - 1). 

Assume now that (|25|) is true at order 5 — 1 and consider order q. Due to the particular structure of 
the matrices A and B, which are null except terms on the diagonal and the sub-diagonal, one has 

(n+q— 3 \ n+q— 3 

]j A(t) diag{Vi;0}= ]j diag{/ 9 _i;0}A(t) diag{/ g ;0}, (26a) 
t=o / t=o 

(n+g— 3 \ ra+<j— 3 

jj A(t) ) diag{0; 7,_i}= J| diag{0;Vi}A(t) diag{0;/ g _i} , (26b) 
t=o / t=o 

and similarly for i?(t). In the previous identities and in subsequent formulas, the products are non- 
commutative: the convention is that t is decreasing from the left factor to the right one. 

Now, it is easy to identify the right-hand sides of the two identities (|2"6"|) with a product of n + (q — 
1) — 3 = n + q — 4 matrices A (resp. B) corresponding to the index q — 1 (the last term in the right-hand 
product in (|26a[) . resp. the first term in the right-hand product in (|26b[) , is equal to diag{/ g _i; 0}, resp. 



22 



diag{0; Iq-i}, and can be suppressed). Using the induction hypothesis at order q — 1, one shows that 

/n+q-3 \ 

diag{V i; 0} f n A (t)J diag{V i; 0} 



{n+q— 3 



7 



n-(g- 



diag{l;...; 7 ?- 2 ;0} diag{/,_ i; 0} ' B(t) \ diag{ 0} diag{ 7 ^ 2 ; . . . ; 1; 0} 



i=0 

/n+q— 3 



7 



n-(«-l)-,-l 



7- 1 diag{Vi;0} diagjl;...^'- 1 } ' B{t) \ diag^ 1 ; . . . ; 1} diag{ I q _ V , 0} 



t=o 



^ n+g— 3 



"« diag{/,_ i; 0} diagll;...^^ 1 } ^ diagh^ 1 ; . . . ; 1} diag{ 7,_ i; 0} 



One establishes similarly that 

/n+q-3 \ 

diag{0;Vi}f J| A(t)j diag{0;Vi} 



7 "-« 



/n+q-3 \ 

diag{0;/,_i} diag{l;...;7 ,_1 } f S(t)J diag^ 1 ; . . . ; 1} diag{0; 



and this is indeed sufficient, due to the structure of the matrices A and B mentioned earlier, to prove 
that (f2l>|) is true at order q. This achieves the proof of ([25]) by induction. 



2. One now estimates the matrix-product 

n+q— 3 n+g— 3 / q—1 \ 

11 ( n i,j) ... • |: • II B(t)= Y[ [ h + £ <*i<t<i+n-2 &i+\<?i J • 

t=0 t=l V i=l / 

Each term of this product is a lower-triangular matrix, so II shares the same property 

The fact that the canonical basis is orthonormal implies that, for any i > j, i,j £ {1, . . . , q}, it holds: 

II M =^~3 card|(t J+ i,...,t 4 ) e {j,j + n-2} x ■•• x [i - l,i + n - 3} nW 3 : t J+1 < ■ ■ ■ < , 

and also that the diagonal terms are equal to 1. The previous formula just means that, for a term in 
e,e^ to emerge from the product, it should be the result of the product 

(e l e]_ 1 ) • (e ? _iej_ 2 ) . . . (e j+ ie]) , 

where each of the term between parentheses comes from a certain matrix A(t) — the rest of the factors 
coming from identity matrices. Conversely, all products of different type vanishes. 

In order to evaluate the quantities IL,j previously defined, notice that the change of variables 

tj+x = ij+ii t'j+2 = tj+2 - 1) • • • i % = U - (i - j - 1) 

yields: 



card j {tj+i, . . . , U) e [j, j + n - 2] X • • • X [i - 1, i + n - 3] n N* 3 : tj+x <■■■ <t, 

= card |(<; +1 , . . . ,<) e j + n - 2] n N) 1 ^' : t' J+1 <•••<<; 
3. We now compute explicitly the value of the function F(m, n) defined on N x N as: 
F(m,n) = cardial,..., t m ) € ([l,n]nN) m : h < ■ ■ ■ < t 



2.3 



Clearly, 

„/ \ „/ x n(n + 1) 

F(l,n)=n, F(2,n)= V - ' . 

Considering separately the cases where t\ = 1, ti = 2, . . . , t\ = re, one finds the following induction 
relation: 

n 

F(m, n) = F(m — 1, i) . 

i=l 

On the other hand, let 

„, , . fm + n - l\ (to + 

G{m,n) = = r . — - , 

\ m J m!(re-l)! 

one has: 

'n\ , . /re + l\ n(n + 1) 



G(l,n) = ( x ) = re, G(2,n) = 



Independently, it is known that 



in such a way that 



n\ ( n — 1\ . i n — 1 
to / \ to — 1 



/to + n - l\ An + n - 2\ An + n - 2\ 
G(TO,n)=l m ) = l m _ 1 ) + l m J = G(m- l,n) + G{m,n - 1) . 

It ensues from repeated use of this formula, that: 

G(to, n) = G(m - 1, ri) + G(m, n - 1) = G(m - 1, n) + G(m - 1, n - 2) + G(to, n - 3) 

n n 

= ... = ^2 G(to - 1, i) + G(to, 1) = ^ G(m - 1, i) 



because G(m, 1) = G(m —1,1) = 1. Having the same initial condition and sharing the same induction 

to + n — 1 
m 



relation, F and G are thus equal, and F(m, n) 



4. The value of F found before is now used to estimate II and next p q . We deduce from what precedes 
that, for i > j , 

tuj = e-i F (i -,>-!)= ?-i (' v;; ■) ?-* (' ■ ~ 2 

Recall that IL^i = 1 and 11$ j = for i < j. 

From the fact that the matrix II above is lower-triangular, one finds out by application of Theorem 
[3 that 

1 _~n+ q -2 = max i.A(n + q-3)...A(0)l = 1 q A(n + q - 3) . . . A{0)1 . 



From f)25|) and the previous computations, one thus deduces 



t q-i 



q — i + n — 2 
n-2 



' 1 — 7 \ ( q - t + n - 2 



q-l 



n-2 



Thus, 



</ — i + re — 2 
V n-2 



^+ 9 -2 = 1 _ 7 n-i^ (1 _ 7)9 -i 
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yl fn + i-2 
n-2 



l/(n+g-2) 



or again: 

/ 9-1 

\ i=0 

This achieves the proof of the first equality in the statement of Lemma |S] 



5. To show the identity of the two expressions in Lemma [SJ notice that 



9-1 

E 



n + i - 2 ■ _ 
n-2 ) (n-2)! 



1 9- 1 J«-2 1 
1 V* _^ rrn+i-2] _ 



(n-2)! dS" 



'9-1 

jn+i-2 

.i=0 

1 d n - 2 

{n- 2)1 dd n ~ 2 



1 _ §n+q-2 
1~S 



On the other hand, one shows easily that 

1 d n - 2 r 



(n - 2)! dS n ~ 2 



1-5 



(1 -5)™- 1 



This permits to deduce the identity of the two expressions in the statement. 

6. Last, we show the limiting property expressed in Lcmma[El From the last formula, one may see that, 
for every n > 2: 

p q = n+ <-yp n (q,6)s« , 

where P n is a polynomial in q and 6 = 1 — 7 of degree n — 2 with respect to both variables. Henceforth, 
taking the limit for q — > +00 yields the estimate: 



lim p q 



lim " + *-yp n (q,6)6« = 6 = l- 7 , 



which corresponds to the true value of the converging rate. Indeed, 



" +q ~^/P n (q, 6) = e lnP ™(«< <5 )/("+9- 2 } = e [(™-2)ln g +ln(l+0(l/g))]/(n+ 9 -2) ^ 

as P n is of degree n — 2 in q. The asymptotic expansion announced in the statement is thus proved, and 
this achieves the proof of Lemma [S] 



References 

[1] M. Akar, R. Shorten (2006). Time Synchronization for Wireless Sensors Networks, Proc. of the 17th 
Symposium on Mathematical Theory of Networks and Systems, Kyoto Japan 

[2] H. Ando, Y. Oasa, I. Suzuki, M. Yamashita (1999). Distributed memoryless point convergence 
algorithm for mobile robots with limited visibility, IEEE Trans, on Robotics and Automation 15 no 
5, 818-828 

[3] D. Angcli, P.-A. Bliman (2006). Stability of leaderless discrete-time multi-agent systems, Mathe- 
matics of Control, Signals and Systems 18 no 4 (2006) 293-322 

[4] A. Berman, T. Laffey, T. Leizarowitz, R. Shorten (2006). On the second eigenvalues of matrices 
associated with TCP, Linear Algebra Appl. 416 no 1, 175-183 

[5] D.P. Bertsckas, J.N. Tsitsiklis (1989). Parallel and distributed computation, Prentice-Hall Interna- 
tional; also downloadable at https : //dspace .mit . edu/handle/1721 . 1/3719 

[6] V.D. Blondel, J.M. Hendrickx, A. Olshevsky, and J.N. Tsitsiklis (2005). Convergence in Multia- 
gent Coordination, Consensus, and Flocking. In Proceedings of the Joint European Control Confer- 
ence/IEEE Conference on Decision and Control, Sevilla, Spain 



25 



[7] S. Boyd, A. Ghosh, B. Prabhakar, D. Shah (2006). Randomized Gossip Algorithms, IEEE Trans- 
actions on Information Theory, Special issue of IEEE Transactions on Information Theory and 
IEEE/ ACM Transactions on Networking 52 (6), 2508-2530 

[8] M. Cao, A.S. Morse, B.D.O. Anderson (2006). Reaching a Consensus in a Dynamically Changing 
Environment (submitted) 

[9] M. Cao, D.A. Spielman, A.S. Morse (2005). A Lower Bound on Convergence of a Distributed Network 
Consensus Algorithm. In Proceedings of the Joint European Control Conference/IEEE Conference 
on Decision and Control, Scvilla, Spain 

[10] J. Cheeger (1969). A lower bound for the smallest eigenvalue of the Laplacian, Problems in Analysis, 
Papers dedicated to Salomon Bochner, Princeton University Press, Princeton, 195-199 

[11] H. Cohn (1989). Products of stochastic matrices and applications, Int. Journal of Mathematics and 
Mathematical Science 12 no 2, 209-233 

[12] A. Czirok, T. Vicsek (1999). Collective Motion, D. Reguera, M. Rubi, J. Vilar (Eds.), in Statistical 
Mechanics of Biocomplexity, Lecture Notes in Physics 527, Springer- Verlag, Berlin, 152-164 

[13] P. Diaconis, D. Stroock (1991). Geometric bounds for eigenvalues of Markov chains, Annals of 
Applied Probability 1, 36-61 

[14] S. Friedland, R. Nabben (1997). On the second real eigenvalue of nonegative and Z-matrices, Linear 
Algebra Appl. 255, 303-313 

[15] P.M. Gadc (1998). Feedback control in coupled map lattices. Physical Review E 57 no 6, 7309-7312 

[16] S.T. Garren, R.L. Smith (2000). Estimating the second largest eigenvalue of a Markov transition 
matrix. Bernoulli 6 no 2, 215-242 

[17] O. Gross, U.G. Rothblum (1993). Approximations of the spectral radius, corresponding eigenvector, 
and second largest modulus of an eigenvalue for square, nonnegative, irreducible matrices, SIAM J. 
Matrix Anal. Appl. 14 no 1, 15-32 

[18] Y. Hatano, M. Mesbahi (2005). Agreement over random networks, IEEE Trans. Automat. Control 
50 no 11, 1867-1872 

[19] M.W. Hirsch (1989). Convergent activation dynamics in continuous time networks. Neural Networks 
2, 331-349 

[20] A. Jadbabaie, N. Motee, M. Barahona (2004). On the stability of the Kuramoto model of coupled 
nonlinear oscillators, Proc. of the American Control Conference, Boston MS, USA 

[21] H. J. Landau and A. M. Odlyzko, "Bounds for eigenvalues of certain stochastic matrices", 1 Linear 
Algebra and its Applications, Vol. 38, pp. 5-15, 1981. 

[22] N.E. Leonard, E. Fiorelli (2001). Virtual leaders, artificial potentials and coordinated control of 
groups, Proc. of the 40th IEEE Conf. on Decision and Control, Orlando, FL, USA, 2968-2973 

[23] J. Lorcnz (2006). Consensus strikes back in the Hegselmann-Krausc model of continuous opinion 
dynamics under bounded confidence, Journal of Artificial Societies and Social Simulation 9 no 1 

[24] S.C. Manrubia, A.S. Mikhailov (1999). Mutual synchronization and clustering in randomly 
coupled chaotic dynamical networks, Physical Review E 60, 1579; also downloadable at 
larXiv : cond-mat79 905083 

[25] L. Morcau (2003). Time-dependent unidirectional communication in multi-agent systems, 
larXiv : math . 0C/0306426I 

[26] L. Moreau (2004). A note on leaderless communication via bidirectional and unidirectional time- 
dependent communication, Proc. of MTNS'04, Leuven (Belgium) 



26 



[27] L. Moreau (2005). Stability of multi-agent systems with time-dependent communication links, IEEE 
Trans. Automat. Control 50 (2), 169-182 



[28] A. Nedich. A. Ozdaglar (2007). Convergence Rate for Consensus with Delays, LIDS Technical Report 
2774, MIT, Lab. for Information and Decision Systems (submitted for publication) 

[29] A. Olshevsky, J.N. Tsitsiklis (2006). Convergence speed in distributed consensus and averaging, In 
Proceedings of the 45th IEEE Conference on Decision and Control, San Diego, California 

[30] R. Sepulchre, D. Paley, N. Leonard (2003). Collective motion and oscillator synchronization. Proc. 
of the Block Island Workshop on Cooperative Control 

[31] J.N. Tsitsiklis (1984). Problems in Decentralized Decision Making and Computation, Ph.D. the- 
sis, Dept. of Electrical Engineering and Computer Science, Massachusetts Institute of Technology; 
available at |http : //hdl . handle . net/1721 . 1/15254| 

[32] J.N. Tsitsiklis, D.P. Bertsekas, M. Athans (1986). Distributed Asynchronous Deterministic and 
Stochastic Gradient Optimization Algorithms, IEEE Trans. Automat. Control 31 no 9, 803-812 

[33] L. Yang, K.M. Passino, M.M. Polycarpou (2003). Stability Analysis of M-Dimensional Asynchronous 
Swarms With a Fixed Communication Topology. In IEEE Trans. Automat. Control 48 no 1, 76-95 



27 



